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TESTING AS A MEANS OF IMPROVING THE TEACH- 
ING OF HIGH SCHOOL MATHEMATICS. 

E. E. BRESLICH, 
University op Chicago. 

Testing, in the sense in which the word used in this article 
does not refer to the so-called standardized test, but to the 
ordinary class examination, or class test. 

In a modem business every detail in the manufacture of 
an object is examined critically. Similarly, the teacher should 
employ a critical examination to measure the results of his 
teaching. Tests may be used to show the complexity of the 
work and to reveal definite problems for the teacher. Indeed, 
it is found that they present more pro-blems than they solve. 
It may be said that the principal value and aim of all testing 
should be to improve the quality of teaching by means of an 
analytical exposition of its problems and difficulties. Opinion 
must be replaced by knowledge, guess work by evidence. This 
type of testing is fundamental* in the progressive organization 
of a course. 

. Briefly stated the method might be as follows : First, some 
concrete aims are set up and agreed upon. Second, tests are 
designed and given, to establish to what extent the abilities 
to be developed in the pupil have been attained. Third methods 
of instruction are developed that are adapted to improve these 
abilities. Finally, suitable tests are devised to determine 
whether the course is actually helping the pupil to gain in 
these abilities in order to help him further if he is still found 
deficient. 

This seems a very simple and sensible program. Following 
this program we shall first make in mathematics a list of the 
important concrete aims of the chapters, principles, or topics 
taught, such as the development of the abilities to manipulate 
the formal operations of algebra, to translate verbal problems 
into algebraic symbols, to grasp space relations, to classify 
and to generalize. Having selected our subject matter ac- 
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TESTING THE MATHEMATICS TEACHER. 277 

cording to our best judgment, the next step will be the design- 
ing of tests by which to measure the achievement of the pupils 
with this subject matter. The problem of constructing such 
tests is as yet only in the beginning stage. 

That the ordinary class examination does not always estab- 
lish the facts desired may be seen from the graphs in Fig. 1. 
They represent the grades of 50 pupils in a test given to three 
classes taught by three different teachers in a third-year course. 
Although classes and teachers vary in ability, the general shape 
of the graphs is about the same. They show that either the 
pupils do very well in the test, or they fail. It is hardly pos- 
sible that in all classes the pupils were either very poor or very 
good, and we may assume that the teachers were at least better 
than the average. Evidently, the test gives no information 
about the poorer students, for the work seemed to be so hard 
that they were unable to show what they could do. Nor does 
it tell anything about the bright students who were able to 
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FiQ. 1. Test in factoring — 50 pupils — 3 classes — 'Mathematics III., Feb- 
ruary 7, 1913. 
Classes I., II. and III. 
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complete the test in less than the required time and therefore 
could not show what they were really able to accomplish. A 
more suitable test must contain enough work of the simple type 
for the slow pupil. It must also contain some difficult work 
which only some of the best pupils can do. The graphs in 
Fig. 2 show that 13 per cent, of the pupils failed. Apparently 
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Fig. 2. Test V. Mathematics I., Chapters VI. and VII. Four classes. 



in this test the slow pupils were able to show that they could 
do some of the work. 

However, in this as well as in the first test, a large per- 
centage of pupils failed to gain real mastery of the work in 
which they were being tested, and needed further teaching. A 
more detailed study must be made to reveal what the nature 
and extent of this instruction should be. 

To measure the results in a test each problem is divided into 
the component elements which enter in the solution. Each 
problem is analyzed as to the processes it aims to test. A score 
of 1 is then given for each process performed correctly. If not 
correct it is scored 0. Attainment it the ratio of the actual 
score made to the largest possible score. Thus, if a process 
is performed correctly by 76 pupils in a group of 80, the ratio 
76/80 =» .95 is the attainment. 
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Before the test is given, a key for scoring the various proc- 
esses is worked out. The following are a few examples show- 
ing how this may be done for some of the typical work in 
algebra and geometry. 

Operations. 

1. Multiplication of monomials is one of the simplest problems 
in algebra. It is also one of the most fundamental processes, 
and must therefore be mastered by all pupils. The problem 
involves three steps, the determination of the sign, the arithmet- 
ical product, and the literal product. 

Each of these is scored separately. For example, in ( — 12m^ ) 
(— 16mr^), 



the sign is + 1 

the arithmetical product is 192 1 

and the literal product is mV^ 1 



Therefore, 
the score 
is 3. 



It must be remembered that the score does not indicate a meas- 
ure of the degree of difficulty or a value of the step. 

2. The division of monomials involves the same three steps- 
Thus in — ^a^cx^y'~-2axy^ the sign 



is— 1 

the arithmetical quotient is 3 1 

the literal quotient is dcx ... 1 



Therefore,, 
the score 
is 3. 



3. The component parts of multiplication of a polynomial 
hy a monomial are the multiplications of a number of monomi- 
als. In the following example this occurs three times. There- 
fore the score is 3, meaning that three operations have been 
performed correctly: 

(3a« — 2a2 + 5a) ( — 2a2)=._6a5 1^ 

+ 4a* 1 ^ 

— lOa^ 1 

4. In the multiplication of polynomials we have the multipli- 
cation of a polynomial by a monomial, and the addition of the 
resulting polynomials. 

Accordingly, the product (a* — a^ — 1) (a 4*1) is scored as 
follows : 
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+ o» — a» — 1 



■a—1 



11 

1 

1 



Therefore, 
the score 
is 3. 



5. In the division of polynomials we have the following 
steps. 



-2o« +1 




ARRANGING TERMS 



J.^ 



DIVISION OF MONOMIALS 1 

MULTIPLICATION OF POLYNOMIALS 
BY MONOMIALS J 

SUBTRACTION OF POLYNOMIALS 



CHECK 



THERE 
FORE 

SCORE 
IS 5 



Similarly we may now show how to analyze the solution of 
equations. 

Equations. 

6. Solution of a linear equation: 

2y-4 2(5 -y) +7 
3 9 



y- 



The processes are 

1. Clearing of fractions: 

9y — 3(2y— 4)=2(5 — y)+7 

2. Multiplying polynomials by monomials: 

9y_6y + 12 =10— 2y + 7 

3. Combining similar terms : 

3y + 12 =17 — 2y 

4. Adding to, and subtracting from both mem 

bers: 

5y =6 

5. Dividing both members: 

y =1 

6. Checking in the original equation: 



{; 



+ 2/3=(8 + 7)/9 
2/3 =12/3 



}'J 



Therefore, 
the score 
is 6. 



7. Solution of a quadratic equation. 
4a?2 + a? — 39 = 
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(4:aj +13) (a? — 3) =0 two factors 2 

4a? + 13 = 
a? — 3 = 



[two linear equations deducted. 



a? = — 13/4 



two equations solved — 2 



Therefore, 
the score 
is 6. 



These scores are used when the process of solving the equa- 
tion is first taught. When these equations occur later the com- 
plete solution may be considered as one operation. 

8. Simultaneous equations. 

(a) Solution by graph: 

1. Make tables 2 

2. Draw axes, and select units 2 

3. Plot points, and graph lines 2 

4. Solve by finding point of intersection . . 1 

(6) Solution by addition or subtraction: 



3m + 7/1 
7m+Sn. 



:34 
:46 



multiply 



21m + 4971 =238 1 

21m + 24m = 138 subtract 1 

25^=100 1 

n =4 solve 1 

3m + 28 = 34 substitute 1 

3m=6 1 

m = 2J^^^^ • 1 

(m, n) = (2, 4) results 1 



Therefore, 
the score 

isT. 



Verbal Problems. 

The verbal problems of algebra are subdivided into a similar 
scheme. 

9. Motion problem. 

A courier who travels 6 miles an hour is followed after 2 
hours hf^ a second courier who travels 7^ miles an hour. In 
how many hours will the second courier overtake the first. 
The following processes are involved. 
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1) Method: 

2) Data for one courier: 

3) Data for the second 

courier : 

4) Stating the equation : 6a; = 7% (x — 2) 

5) Solving the equation : 6x : 



< 


r 
6 


.d 


X 


6x 


x-2 


7i 


7J(x-2) 



a; = 10 



1 
1 
1 

.1 



The 
dcore 
for the 
whole 
problem 
is 5. 



10. Geometric problem solved algehraically. 

One side of a rectangle is 7 feet longer than twice the other, 
the perimeter being 54 feet. Make a sketch of the rectangle and 
find the length of the sides. 



1. Let or be the number of feet in one side 
Then 2a? 7 + is the numbor of feet in 

the other side ^ 

Figure: 2x + 7 



data . 



2. State equation: 2aj + 4a! + l*=54. 1 

3. Combine: 63? + 14=364. 

4. Subtract: 6a; = 40 solution. .1 

5. Divide: aj = 62/3 

6. Other solutions: 2a? + 7 = 201/3 1 

7. Check: 62/3 + 62/3 + 201/3 + 201/3 = 54. . .1 



There- 
fore 
the 
score 
is 5. 




11. Problems In Indirect Measurement. 

Figure and notation 1 

Alternate int. angles are 

equal \ 

tan 44** =«/450 Choice of function 1 

a?3^450tan!(4 Solution 1 

a=450(.966) Use of table.... 1 

aj = 434.7 Arithmetical computation 1 



Therefore, 
the score 
is 6. 
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Geometric Problems and Theorems. 

In the scoring of theorems or problems in geometry the fol- 
lowing general method is used: 

1. Figure and helping lines 1 

2. Given, to prove 1 

3. Explain how helping lines are drawn 1 

4. Congruent triangles 4 

5. A single statement giving a correct inference with the 

correct reason for it 1 

The following proof illustrates the method. 

12.* Use of the indirect method of proof. 

Theorem: Two lines that cut two intersecting lines and make 
the corresponding segments of the given lines proportional are 
parallel. 

Given: DE and AB cut by CA and (75, making 

CD/DA = CE/EB 1 

To prove:Z>£' \\to AB J 

Figure: 




A ^ ■ ^ ^^ 

Proof: Assume DE not parallel to AB ,. . 

Draw AF parallel to DE 

Then GD/CA==OE/EF 

But CD/DA = CE/EB 

/. CE/EB = CE/EF 

.-. CE'EF=GE'EB 

.*. EF = EB 

This is impossible 

.'. The assumption is wrong 

OF parallel DG parallel EB 

13. A construction with ruler and compass. 
To divide a segment into three equal parts. 
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Given: A segment -45 1 

Required : To divide AB into 3 equal parts j 

Construction : 




^^ ^ Draw helping line 1 

Lay off 3 equal segments. . . 1 
^ p— G B Draw parallels 1 

VTOoi: AC = CD = ED 1 

C'/?' parallel />(? parallel i?5 1 

AF=FG = GB 1 

To obtain a clear understanding of the study of tests we may 
ejcamine in detail the results of one of the tests given to a class 
in First- Year Mathematics. None of the problems in this test 
were taken from the text book used by the pupils. The test is 
as follows. 

Test Vm., Mathematics I. 
I. Change to the simplest form by collecting terms 
6aj2_^8 — 30?* — 5 — 9a?2_7 

Zg + f-^9-^f-1g-^f 

— 8^— « + 6^ — 3^+2^ = 9^ 

— 2aJ — 3^ + 7a6 + Tgr + Qdb^^g 

II. If t? =. 4 and / = 2 what does 2t?« — 3/ equal ? 
if a=3 and 6 = 2 what does 3a& + db^ equal? 
if aj=3 and y = 4 what does xy^ — 2ajy equal? 
if r = 2 and 5=4 what does r^ -|- 3/^5 equal ? 
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III. From U + 13/ take U + 14/ — 6pr 
Take 9A 4- 14A; from 7A — Zle + 8s 
Subtract 6m — lln. + 13p from m + 3n, + 7p 
IV. Perform the indicated operations and reduce to the 
simplest form : 

3(72/)= (4aj) (-3a!y») = 

(2a) (4a&2) = (a») (—3a) (—2a) = 

"2/3 of 9wi= (— 3iBy») 4= 

V. Simplify 7 (5ir + 9); 5(8aj— 4) ; — 6(5a! + 2) ; 
— 9(4a! — 6); 7(— 6a> — 4); — 8(— 4® — 6). 
VI. Perform the indicated operations and reduce to the 
simplest form: 



\2n 


7a 7o=' 


4 ~ 


15 • 20 


6c5 -^ 2(? = 


-12ar'3/2-(a;-2) 


-3a;V 


4o2 




5 





VII. Perform the indicated operations and reduce to the 
simples form: 

(2a2 + 7a - 9) (5a - 1) = 
18m^n - 27mn^ __ 
9mn ~~ 

{x^ - a:2 - 4a: + 4) -^ (a:^ - 3a; + 2) 

VIII. Show graphically each of the following statements to 
be true. Explain your drawing. 

(+8) + (_2)= + 6; (-6)- (-2)=-4; 
(—2) (— 4)= + 8; a& + a(?==a(& + c) 

The first step in the study is to make the key for scoring. 
To avoid needless repetition only part of the key used in scor- 
ing the test above is shown as follows. 
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Key for Test Vin., Mathematics I. 

I. — 6a?2 — 4 Cambining terms 2 [ 

® J score 9. 

II. 2 . 16 — 24 = + 8 Substitute, multiply, com- ) Total 

bine 3 j score : 12. 

III. —6d—f + Qff Each term is scored 1, if ) Total 

right 3 J score 9. 



IV. 21y Numerical product 1 

Sa^b^ Numerical product, literal product. 2 

6m Numerical product 1 

— 12 ar^y^ Sign, numerical product, literal 

product 3 

+ 6a« 3 

+ 81 a?*y" 3 



Total 
score : 13. 



V. 35a? + 63. Each term scores 1, if correct. ... 2 l'^^^^^^ 

J score : 12. 

VI. Sn Arithmetical quotient 1 

Sc Numerical part, literal part 2 

— 2& Sign, numerical part, literal part. . . 3 rp . i 

( 2/5 aj2 Invert, multiply, reduce 3 L-^^^^^ 

1 4/3a Invert, multiply, reduce 3 ^^^^ ' ^^' 

+ 4 (a? — 2) Sign, numerical part, literal 
part • 3 



VII. 



lOa^ + 35^2 _ 45a+Polynomial by mo- 
nominal 

— 2a^ — 7a + 9 Polynomial by mo- 
nomial 

10a« + 33a2_52a-f 9 Combine 3 

^ 9mn{2m — Sn) "] 

9mn iFactor, reduce 2 

L2m — 3n J 

x^ — ^x^ + 2x 

2a?^ — 6aj + 4 1 I^ivide, multiply, sub- 
' tract 3 



Total 
score : 8. 



x + 2 
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VIII. 

Total 
score : 12. 



+ 6 



+ 2 



+ 8 



— 1-2) -4 



^ c^r-r—r 



-6 



-4 



b+c 



ab 



ab-t-aCf a, b + c 3 



It appears that ninety different operations were to be per- 
formed in this test. 

Having scored each process of every problem for every paper 
by following the directions of the key, we find for every proc- 
ess the ratio of the number of scores actually made to the ratio 
of the total number possible. Table I., below, gives these 
ratios for every problem for each of the four classes. It shows 
wide variation in the result of the classes, the largest interval 
being 32 and the smallest 11, 

TABLE I. 



Probleme. 


1 


2 


3 


4 


6 


6 


7 


8 


Olftss T 


96 
83 
64 
92 


85 
71 
86 
69 


94 
85 
67 

77 


94 
79» 
75 
81 


98 
98 
87 
90 


88 
64 
66 
71 


78 
64 
56 
56 


81 


Class II . . 


59 


Class III . . 




Class IV 


62 






All Hass«8 


88 


71 


84 


86 


96 


f 


64 


69 






Variations , . . , 


N 


17 


27 


19 




ll] 


24 


1 
22 1 22 









The table should be read as follows. Class I. in problem L 
had an attainment of 96, etc. 

Notice that the results in the various classes show wide 
variations, the largest being in problem 1 and the smallest in 
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problem 5. Class I. makes the best showing and class III. the 
poorest. An explanation of this difference may be found by 
securing collaborative evidence from the teachers. With a 
little more teaching of problems like 2, 7, and 8 class I. seems 
to be prepared to go on with the course, while class III. might 
as well study the whole chapter a second time. 

If the problems are now ranked in order of attainment, table 
II. it is seen that the variations in rank are small. 



TABLE II. 



Problems. 


1 


2 


3 


4 


5 


6 


7 


8 


Ranks for class I 


2 
3 

s 

1 

2 


6 
5 

s 

6 
6 


3 

B 

4 
4 
4 


3 
4 
3 
3 
3 


1 

1 
1 
2 

1 


5 
6 
5 
5 
5 


8 
6 

7 
8 
8 


7 


** *• " II 

" " III. 


8 
8 


•' •• •* IV 

" aU classes 


7 
7 







Thus, problem 5 was very easy for all classes and problem 
2 was hard. The remaining prablems very nearly kept their 
positions. The table shows a uniformity in the results of the 
teaching in the four classes, because the ranks of the problems 
are practically the same although the classes are apparently 
not of equal ability. 

Of special interest are the three exceptions marked with 
squares. When the teacher of class II. was asked why his 
class did so well with problem 3, he said that former experi- 
ence had taught him that subtraction of polynomials is a 
difficult process. Therefore he placed great emphasis on this 
operation in his teaching. He apparently accomplished good 
results because in the subtraction of polynomials which enters 
also in problem 7, as part of the long division process,/ his class 
was superior to all others, the ratios for this process being 
respectively 54 per cent., 74 per cent., 38 per cent., 39 per cent. 
This also brings out the fact that a process is more difficult 
when it occurs in a new situation than when it occurs alone, 
— the ratios for this particular process in problem 3 being con- 
siderably higher, 94, 85, 67, and 77. 

Class III. did not succeed well with problem 1. The 
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teacher's opinion was that the word " collecting " was new to 
the pupils, the word " combining " being used in class. Some- 
times the use of an unfamiliar word in a test confuses the 
pupils, and the results do i^ot indicate at all to what extent 
they are really able to work the problem. 

Further evidence of their ability to solve this problem may 
be found by studying to what extent the pupils are successful 
when the same operation occurs elsewhere. For example, terms 
are to be collected in the third step in problem 7. The ratios 
for this step for the various classes are 81 per cent., 53 per 
cent., 23 per cent., and 60 per cent., showing that class III. is 
deficient in this process even when no instructions as to " col- 
lecting " or " combining " are given. In fact, an examination 
of the papers of the pupils verifies that they did not under- 
stand the process, for such mistakes as a^ -{- a^ =^ O^ were f re^ 
quent. 

On this basis of the results of this study the teacher during 
the next class hour retaught the process, and similar errors 
were carefully corrected in the later part of the course. 

That this class can be trained with careful teaching to do 
as good work as the others, or even better work, is seen from 
the fact that they surpassed all other classes in problem 2. 

By arranging the various processes in the test in order of 
attainment some interesting comparisons can be made. The 
order is as follows : 

TABLE III. 

Processes. Attainment 

1. Multiplication of a binomial by a monomial 93 

2. Graphical addition of positive and negative nnmberB 92 

3. Combining similar terms ^. . 84 

4. Subtraction of polynomials 84 

5. Multiplication of monomials 83 

sign 80 

numerical product 86 

literal product 80 

6. Beduction of fractions 78 

sign . *. 72 

numerical part 80 

literal part 78 

7. Multiplication of two polynomials 73 

product of monomials 80 

adding polynomials 50 
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8i S¥ftlUfttiO& 1 1 1 1 1 1 1 1 1 I 1 1 I 1 1 t 1 1 I 1 1 i 1 1 1 1 I I I I i t I I I I I t I I • i9 

ittb0tittEitl!O& 1 1 1 1 1 • 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 i I i I 72 
pfoduet el po^ti?e and a9fati¥§ aumlb@fs... it 

OMibi&i&g tdfmi 67 

9. Mtidlipl;^ positive ft^d aeg Ali^d aufflb«f g paphiealfy 65 

10. ^?itog hf a £ifa@t4o& 61 

i&^^niofi ( . ( i . . . t . . I . t . . . . . I . ( 67 

multiplidAtio& 6S 

f§dttetld& ................................ 53 

11. 3f a^oaI subtf aotiofi 61 

Ifl. DiYiiiofi of pol^^iUli 56 

di¥igi^ of fflo&offliali .................... 64 

pf oduot ei pol^^iial b^ mo&omial 54 

iubtf aetioa of pol^omials ................ 50 

The tabli showa that bist rtiults wtra ittilMd with multi- 
plying binomiali by monomials, and tht poorest in adding 
and subtracting polynomials as shown in 7 and 12. Jhnoi, 
^ lattif niid to be emphasized and used in many situations 
before they are really understood, 

Graphioal addition and subtraction were given as experi- 
paental problems. These prooesses are ordinarily used for 
Illustrative purposes and not as an aim in themselves. It is 
not intended to drill pupils to be able to reproduce tl^m. Yet 
one of them was retained as well as anything given in the 
test; the other proved to be difficult. 

The results show uniformly that a process, when mastered 
alone, is not sufficiently understood until it has been mastered 
^n different situations. For example, the product of monomials 
shows an attainment of 88; in process 7 it shows 80, in evalua- 
tion 69, in division 62. Similarly, for reduction of fractions 
we have an attainment of 78, in process 10 it Aows only 85. 
For combining terms we have 84, but in evaluation only 07. 
For multiplication of polynomials by monomials we find an 
attainment of 80 in process 7, and S4 in process 12. 

Subtraction of polynomials: alone 84 per cent., in long 
division SO per cent. Multiplication of polynomials by a 
monomial! in multiplication of polynomials 80 per cent.; in 
long division 64 per cent. 

It is evident that when a new process is taught, the previous 
processes involved offer new difficulties, and deserve consid- 
erable uncial attention. A similar situation is met when 
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arithmttical computations occur in an alpbraic probltm. 
Errors such as 2^ X B0 ^ Bw^ are common. Certainly tht pupil 
knows that 2 X B ^ 6 but ha must now oonotntrat^ on two 
procissis at the same time, and he must learn to do both cor- 
rectly. A review or drill in arithmetic alone will not help 
him to avoid such mistakes. 

The process of long division standing at the bottom of the 
list, is a type of proBlem frequently entirely omitted from a 
first-year course. Since it serves as an excellent check on the 
extent to which the more fundamental processes are actually 
retained and carried over, it seems unwise to omit the teach- 
ing of long division of polynomials. 

The test here recorded in full shows that an analytical ex- 
position reveals the difficult parts involved in an operation 
or in a problem. This information may then be used to teach 
the problem again with an improved technique or in different 
situations. Moreover, similar records kept of all tests would 
be valuable to the teacher when he gives the course a second 
time and ultimately such systematic testing must lead to a well- 
organized course. 



